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THE COMPUTER -CONTROLLED OCXJLQMBTEft: 

A PROTOTYPE INTERACTIVE EYE MOVEMENT TRACKING SYSTEM 

By 

Matthew j, Hillsroan, 
r. wade Williams and John s* Roe 

SUMMARY 

One kind of eye movement tracking device which has great 
potential is the digital computer-controlled Ocuiometer, an 
instrument which non-invasively measures point of regard of the 
subject 4 as well as pupil diameter and blink occurrence* in 
conjunction with a computer-generated display which can change 
in real time as a function of the subject's eye motions, the 
computer-controlled Ocuiometer makes possible a variety of 
interactive measurement and control systems. Practical applica¬ 
tions of such schemes have had to await the development of an 
instrument design which does not inconvenience the subject, and 
which conveniently interfaces with a digital computer (see Ref* 1)- 
This report describes an Ocuiometer subsystem and an eye- 
track ing/control program designed for use with the PUR-6 computer 
of the rt.I.T* project MAC Artificial intelligence Group* The 
Oculometer electro-optic subsystem utilises near-infrared light 
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reflected specularly off the front surface of the subject's 
ctprnea and diffusely off the retina, producing a bright pupil 
with an overriding corneal highlight * An electro-optic scanning 
aperture vidissector within the unit, driven by a digital eye¬ 
tracking algorithm programmed into the fdp- 6 computer, detects 
and tracks the centers of the corneal highlight and the bright 
pupil, to give eye movement measurements. A computer-controlled, 
moving mirror head motion tracker directly coupled to tho vidis¬ 
sector tracker permits the subject reasonable freedom of move¬ 
ment . Various applications of this system, which are suggested 
by the work reported here, include: (a) using the eye as a con¬ 
trol device* (to) recording eye fixation and exploration pat¬ 
terns, (c) game playing, {d) training machines, and (e) psycho 
physiological testing and recording* 


INTRODUCTION 

in some measurement and control r itnations involving human 
vision It appears advantageous to monitor, or in some manner 
utilize, certain eye movements. The Oculometer is an instrument 
which was developed by the Honeywell Radiation center under Con¬ 
tract NAS 12-531 for the NASA Electronics Research Center for the 
purpose of investigating problem areas involved with the above. 


2 


The instrument simultaneously and dynamically measures pupil 
Centroid position (eye position) r pupil size,, eye optical axis 
pointing direction and blink occurrence* when the instrument is 
operating the subject Vs eye is irradiated by a collimated source 
Of near-in fra red energy. The llear^ in fra red radiation reflected 
from the subjects corneal and retinal surfaces is detected by a 

scanning aperture image dissector (vidisSector) which is sensi¬ 
tive to the source output (see Fig* 1), Both the near-infrared 
source and vidissector are located within the Qculometer electro- 
optical unit and share the same optical axis- Eye movements are 
electronically derived from measurements of the vidiasector out¬ 
put signals, which include information about the position of the 
corneal reflection relative to the centroid of the pupil-iris 
boundary. This latter information is used to determine eye 
pointing direction (sa-e Fig, 2 ) . By using near-infrared tech¬ 
niques for measuring eye movements, the Oculomotor presents vir¬ 
tually no interference to normal vision. The outputs of the 
instrument are real-time electrical signals directly proportional 
to the measured eye movements* 

Two different laboratory prototype models of the oculometer 
were designed and fabricated for NASA.* one model was a proximate 
instrument (Ref„ 2) and the other a remote version (Ref, 3)~ The 
feasibility of the Oculomotor concept was successfully demonstrated 
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Figure 1 OOJLOMETER EYE ILLUMH&TIOH/DETECTIOH TECfcPHQUE 













SUBJECT’S EYE OCULOMETER IMAGE FOCUSSED ON 

- OPTICS VIOISSECTOR PHOTOCATHODE 



Figure 2 EYE POINTING DIRECTION VS, PUP IL/CORNEAL HIGHLIGHT 

POSITION 












with these instruments; however + toeing developmental units- their 
operational and .measurement capabilities were sOftieWh&t limited* 

With the Proximate Oculometer, which wee the first version 
of the instrument to be built, the user observed the field of 
view through a 7-cn diameter dichroic beamsplitter attached to 
the instrument's optical head* This particular optical configura¬ 
tion restricted subject head motions, accommodating only a 
_Kl*3-cm lateral and longitudinal range of eye positions. Never¬ 
theless, both horizontal and vertical angular eye pointing direc¬ 
tions of up to +15 13 and pupils of 2-mm to 9-mrn diameter could be 
measured with accuracies of approximately 0,5° and 0*2 mm respec¬ 
tively. Blinks were detected and measured as they occurred* 

The Remote Oculometer , which was built some months after the 
proximate unit, was a more versatile instrument. The user was 
allowed a +5*3-cm lateral and +2.5-cm longitudinal range of head 
motions and accompanying eye positions at a distance of approxi¬ 
mately 1 meter from the optical unit, and was not required to 
view the scene through an intervening aperture, such ae a beam¬ 
splitter * This method of operation was accomplished by using a 
aervo-eontrolled moving mirror system to automatica1ly track eye 
position as the head moved, with this latter system lateral head 
movement rates up to 25 cm/sec could be followed. The remote 
version of the Oculometsr also retained the other eye movement 
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measure?) ent features and accuracies described for the proxi.Ts.te 
unit* 

Proposed tcAsA plena for future Gculometer work included 
investigating the feasibility of using a small digital computer 
to replace the existing aha log—digital hybrid electronic control 
unit (see Refs* 2 and 3)* This latter unit suffered from elec¬ 
tronic instability problems over long periods of operation and 
was not amenable to control program change since it was a hard¬ 
wired system. The digital computer technique of ocuLometer con¬ 
trol was expected to allow electronically stable and simplified 
instrument operation, ease of control program change, and con- 
venient calibration of output signals. Also, with digital com¬ 
puter control, eye characteristics peculiar to a specific user 
and common subject-to-subject eye variations could be readily 
dealt with, in addition, the digital computer could be flexibly 
programmed to allow selected visual functions of the subject to 
control external devices, if desired* 

Baaed on the proposed NASA plans, the m.i,T. Project mac 
A rtificial intelligence Group was contracted by the NASA Elec¬ 
tronic Research Center to investigate the feasibility of a digi¬ 
tal- computer- controlled Oculometer. This work, the results of 
which are reported here, involved the development of an on-site 
fM.l.T. Project MACJ Oculometer measurements facility, as well 


7 


as £ u vi&ral sp^cLa X i zed £ onput^r programg gpfl l/O intGrfaCrG£ 

■ 

suitable for use with an Qculomet ur elect ru-opt ica J unit a nd the 
M.l.T* project MAC PDP-6 computer- An Oculomotor electro-optical 
unit with its associated electronics {power supplies and A-D 
hybrid control unit} Wifi provided as <J OV er nmetl t - fur ni shed equip¬ 
ment* The A-D hybrid control unit section of the Goniometer 
electronics was disabled for the performance of this work since 
it was to be replaced by the PDF’-*? computer, the j/o inter face, 
and the control programs* At a later date during the contract 
period the original Oculometer power supplies were replaced with 
an improved unit {see Appendix E)* The computer programs gener¬ 
ated during the performance of the work reported here were 
developed by and modeled in part on earlier work of Geffner 
(eee Ref. 4}. 

THE COMPUTER-CONTROLLED OCULOMETER SYSTEM 

Basic Description of a Prototype 
Interactive Eye Movement Tracking System 

The prototype interactive eye movement tracking system devel¬ 
oped under this contract consisted of the following components: 

a) The Remote Oculometer electro-optical unit and power 
supply? 

h } The PDP-6 computer {a PDF-10 computer also was avail¬ 
able and could be used interchangeably with the pdf -G without 
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program modification); 


c) The l/o interface circuitry; 

d) The Goniometer eye-tracHing/rontiol programs; 

e) An Xj,Y video display; 

£) A TTY or video display-type i/o terminal; 
g) A high-speed line printer* 

The basic interconnections of this particular system are 
shown diegrammatically in Fig. 3. The experimental apparatus 
described here is unique in that it is unlikely to be duplicated 
elsewhere in this particular configuration* However, the flexi¬ 
bility of the digital computer approach to eye tracking is such 
that the programs developed here could be rewritten without 
excessive difficulty for other suitable computer facilities. For 
complete eye-tracking system operation it would of course be 

necessary to obtain an Qculometer electro—optical unit and power 

■ 

supply and develop the necessary I/O interface circuitry* 

Oculqmeter Electro-Optical unit and Power supply 

The Oculometer electro-optical unit and power supply used 
in this work has been described in Refs* 2 and 3* Basically, 
the Oculometer electro-optical unit consists of the following* 
a) A near-* in fra red radiation source and optical assembly 
used to illuminate the pupil and cornea of the subject's eye; 
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Figure 3 COUPUTER-COETTROliLK''* OCtlLOMETER SYSTEM fBASIC) 
















































































b) A dual-axis moving mirror optical assembly (capable of 
being disabled and operated in a stationary mode) for tracking 
gross head-eye motions in a lateral plane perpendicular ta the 
optical axis; 

c} A acannmg aperture image dissector {vidissector) and 
optical assembly used to acquire and track the pupil and corneal 

linages of the subject . 

A line drawing of this unit is shown in Fig. 4. A detailed 
description, of a modi fled Oculometer power supply appears in 
Appendix ft- 

Oculmoeter/COmputer System Environment 

The computer environment of the prototype interactive eye 
movement tracking ay stem was the E ncompat ib le Time-'Sharing Sys¬ 
tem (115} of the M*1_T* Project wag Artificial intelligence 
Group. The iTf system consists of the following major components* 

a) One ppp-lo computer; 

b) One PDF-ft computer; 

c) One 256X r 3ft-bit word, mass core memory; 

d) Four &M A 9-bit character, disc memory units; 
ej peripheral terminals end I/O interfaces. 

Howeverj the eye movement tracking system was not run in a time¬ 
sharing mode* Thu mods of operation used in this work was as 

■ ■ 

t ollows: 
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Figure A REMOTE OCULCMETER ELECTRO-OPTICAL 















a) The ocu.lometer eye-tracking/control programs were loaded 
into the mass core memory from the disc memory unit. That Opera¬ 
tion was accomplished; through the PDF-10 computer and a display- 
type 1/0 terminal located near the Oculometer electro-optical unit. 

b) From the above, the tracking/control programs were sub¬ 
sequently loaded into the 16K, 36-bit word memory of the FDP-6 com¬ 
puter, sqain using the l/o terminal located near the oculometer 
electro-optical unit* 

c} OCU lometer operation depended only upon the PDP-6 computer 
once its memory was loaded. Program changes/inputs to the oc Sa¬ 
lome ter/PDP-6 system were buffered through the PDP-lQ/maas core 
memory system from the Oculometer l/o terminal* This was the only 
concession made to the ITS system during the Qcul cane ter /computer 

system operation* Pig. S shows the complete system block diagram. 

■ 

Physical Arrangement of the ocu lometer/computer System 

! 

The physical arrangement of the Oculometer/computer system is 
shown in Figs* fi, 7, 8 and 9 + The Oculometer eiectro-optica1 unit, 
jc r Y video display, display-type I/O terminal, and l/o interface 
circuitry were located in the M„I*T* Project MAC A+I, Group Eye 
Tracking Laboratory. These components of the system were coupled 
by approximately so ft of coaxial cable to the PDF~6 computer which 
was located nearby. Fig, 10 is a line drawing depicting the loca¬ 
tion of the subject relative to the position of the components of 

13 
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Figure 5 


COMPtfTER-COHTROLLED OCULOMETER SYSTEM {DETAILED} 
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REMOTE OCuLOHETEJt AND VIDEO DiSPLAV I/O TERMINAL 











Fi^u'rft (3 REHOTE OCULQMETEit WITH SUBJECT AXD OPERATOR 


































Figure 9 3.EMOTE OCULOHETER WITS SUBJECT IS OPERATING POSIT LOS 
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Figure 10 SUBJECT POSITION RELATIVE TO SYSTEM COMPONENTS 











































the eye- trucking system which were located in the Eye Tracking 
Labo ratory. 

To operate the eye tracking system the subject first was 
comfortably ski ted at the proper position in front of the Ocu¬ 
lomotor o lectco-opt ica X unit* The operator would then command 
the PUP-6 with the routine eye-tracking/control programs through 
the i/o terminal and proceed with the experiment. Either eye of 
the subject could be used for eye tracking experiments, and the 
operator and subject often were the same person, 

Oc li 1 Quieter Electro-Optical Unit/X, Y Video Display Hardware 

The Oculomotor/video display 1 is r dwar e performs three 
functions: 

a) It enables the eya^track/control program to measure 
(at approximately 300 microseconds per point) the brightness of 
any point or scries of points rn the field Of view of the OCU- 
lomater vidissector (normally a point in the pupil or on the 
cornea of the subject"s eye)* 

b) It enables the Oculometer (vidisgectar) field of view to 
change hy repositioning the dual-axis hesd/eye tracking mirrors, 
either under manual or ralrror-trach program control, 

c) Tt enable* the video display program to write a point 
or a series of points (to constitute a line drawing) on the x r ¥ 
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video display. 

The hardware is linked t-o the computer via the l/o bus by the 
I/O interface circuitry. Thie circuitry consiatg of level con¬ 
verts (see Fig. 5) (the l/o bus uses EEC levels of -3 V and D V* 
the Qculometer electro-opt ical unit logic uses TTL levels of 
+3 V and 0 V)„ Oeulometer control (see Fig* 11), and the serial 
I/O interface (see figs* 12, 13, 14 and 15)* The serial i/o 
interface (see below) recognizes device numbers 544, 550 and 554* 
These devices specify dual-axis mirror, vidissector, and video 
display deflections respectively. The larger part of the inter¬ 
face circuitry is at the I/O bus itself* The interface circuLtry 
serializes data for the above three devices and sends it via one 
coax cable to the serial l/O interface remote., which is located 
with the Oculometer electro-optical unit* The l/o interface cir¬ 
cuitry also does the final decoding and loading of the proper 
GftC's* The Oculometer control recognizes device numbers 534 and 
540j the latter device starts the (eye) point brightness measure¬ 
ment, while the former is used to input the result of the measure¬ 
ment to the eye-track program for processing* The computer word 
data format used in the operation of the above is shown in Fig* 16* 

Operation of the Oculometer/video display hardware is as 
follows: 

a) To measure the brightness of an eye point in the vidie- 
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Figure 11 OCULQMETfiR CONTROL (DWG, #C-072469) 
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Figure 12 SERIAL I/O INTERFACE {COMPUTER) (DWG- #0-072669-1) 
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Figure 13 SERIAL i/G INTERFACE (COMPUTER) (£WG* #C-Q72B69-2) 
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Figure 15 SERIAL I/O INTERFACE {RH40TB) (DWG, #C-072769) 
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Figure 16 COMPUTER WORD DATA FORMAT 






































































viiUsseotor field of view, the coordinates of the desired point 
are loaded (by the eye-track program) into the DA.Cs which drive 
the uidiEaector deflection amplifiers* The video signal developed 
by the vidissector as a result of the deflect ion-detect ion func¬ 
tion is time-averaged by an integrator in an Integrator"threshold 
detector {see below) to reduce its mjiRe content T The final 
result is made available to the i/o bus by the I/O interface! 
which may request an interrupt when data is ready for processing. 

h) The head/eye tracking mirror servos 1 command inputs may¬ 
be taken either from manual {or off-line) control potentiometers 
(for static control) or from two dag 1 s loaded by the mirror-track 
program (for on-line dynamic control). However + during the major 
portion of this work, electro-mechanical difficulties experienced 
in the computer-eontro1 mode of operation of the tracking mirror 
servo assembly {sea Ref. 3) (resulting from Inefficient torque 
motors) forced the abandonment of its operation, other than under 
manual control. 

c) The display program loads QAC's which drive the video 
display deflection amplifiers and cause the display beam to be 
positioned at the desired on the video display, the beam is 
deflected off screen* 


28 


Operation of the Serial 1/0 Bus interface 

A serial interface has been constructed to drive the Ocu- 
lometer* This device can also connect to additional transceivers 
for remote I/O transmission- The device consists of a master 
transceiver at the computer and one or more slave transceivers 
which connect to the master through two coaxial cables. 

The line from master to slave sends self-clocking bits at 
10 + 5 mhz + A zero is sent as a 2Sne pulse, A one is 7 5 ns long + 
The loading edges of both ones and seres are in the same phase 
and occur every 95 r.s+ when the line is idle a stream of ones 
is sent continuously. If an output command is given -(COHO 554 
550 or DA TAG 554 550 554} a 42-bit message is sent* It consists 
of a zero, the state of IOS9* the state of IDS0, a bit to indi¬ 
rate COHO (0} or DATAG (1}, two ones, and 36 bits of data (bit 
35 first)+ 

An input command is initiated with a 00W0 554- The 42 bits 
□ ecit are a zero, IOB20, IOB19, lOBlS, and 3B zeros. The lines 
from slaves to master are active-low and are all or-ed together. 
The addressed slave sends its data low-order bit first during the 
last 36 bits of the message* The data can then be read into the 
computer with DATA! 5 54* 
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Operation of the mtegrator-Theshold Detector 

The Integrator-threshold detector (fig* 17) (and power supply 
Fig* 17a), together with the counter (a part of the Oculometer 
control) , performs the actual eye-point brightness measuroment. 
When an eye—point measurement id started (after the desired vidis- 
aoctor deflection has occurred) an integrator sums the vidissecfor 
anode current until the sum reaches a manually adjusted threshold, 
T. This sum at any instant during integration is proportional to 
the total number of photons incident on the selected port of the 
vidiesector phatocathode since integration was begun; the actual 
value of the sum is 


f [output of integrator) ^ V^ nt 


— 'e 


'l* •? ft 


m 


int 


where o. a i*g x 10" coulombs, i » photocathode quantum effi— 

o 

oiency (-*1.5% at 7500 ft), ■ vidissector electron multiplier 

gain (^1.4 x 10“) r and c. — integrating capacitor (-*27 pf) * 

1 , I 

Thus, for this system, V^ t at 1.25 x 10 -3 volts/photon, or if we 
define I “ 1/v, I = 300 photgns/voIt. Since the arrival of 

■ 1 ■ . . ■ I 

photons, their conversion by the photocathode, and the instan¬ 
taneous value of the multiplier gain are all random processes 


obeying Gaussian 


, the standard deviation (i.e. probable 

vnTF 


error) of the integral j (output of integrator) is 
where N/t is the number of photons observed as of time t_ 
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Figure 17a QCUUiMETER INTEGRATOR — THRESHOLD DETECTOR POWER SUPPLY {DWG. #UX22972 













































during the integration* Because the threshold T corresponds to 
a certain number “ XT) of photons, the accuracy of the mea¬ 
surement is proportional to VT; in this device 10 mv < T < 5 v 
-*8 < N < 3500* Thus, available signal-to-noise ratios are 
3,5;1 to 63*1; any value in this range may be chosen by the 
experimenter to optimise the inherent trade-off of measurement 
accuracy vs* speed of operation* 

The integrator is reset and started by the Oculomotor con¬ 
trol logic via one coaxial cable, when the logic level on this 
cable is low ( p false") the integrator i3 reset; this level Is 
stretched by 1*4 *is to ensure complete reset, when the level is 
high C’true") the integrator is allowed to run, it returns to 
the control logic level via another coaxial cable which is high 
{’'true") when the integrator has been started but not yet reached 
the threshold, i,e* V^ nt < V , and low ( H false 11 ) at all other 
times * The counter* located on tho Qeuiometer control card, times 
the "true" interval in increments of 47.6 ns* since the counter 

has 12 bits, the longest integration time measurable is 

12 

47*6 x 2 = 194 «e. If the integration takes longer, the 

counter overflows* measurement stops, and the overflow flag is 
set in the returned value* This tells the program that the point 
we g dimmer than N^/194 x HD 6 photons/sec at the photocathode* 



Basic Description of the 
Oculometer Eye-Tracking/Control program 

The body Df the Oculometer eye-tracking/control program con- 
eiste of thirty-two (32) pages of standard line printer listing 
written in MIDAS, the machine- language assembly ay stem. The entire 
program utilizes approximately 6K words of the 16K-word core 
memory of the FDP-6 ccctputer. The following is a summary of this 
program, including page number (s), routine tltle^e), and a brief 
description of the indicated routinest 


Program 
Page {s) 

Routine Title{s} 

Description 

Constants and variables 

1-2 


3 

CIB 

TTY or display I/O terminal input 
routine 

4-5 

B 

—. 

More constants and variables 

6 

SCRTST 

Coarse raster display of pupil/ 
corneal intensity seen by the 
vidissector 


IHIT 

initialization rod: ine 

7-0 

RASINI, ROEINI 

Subroutines which generate succes¬ 
sive 3£,Y coordinates of a raster 

9 

ClRINI 

Subroutines which generate succes¬ 
sive X,Y coordinates of a circle 

10 

EYTRAK 

Main eye-track routine 

11-12 

SLINK 

Routine which handles various con¬ 
tingencies when eye—tracking fails 

13 

PUPTK 

Pupil tracking routine 
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14 


CORTK 


Corneal tracking routine 


15 FUFGET 


pupil acquisition rout ine 



17 

10 

19 


SNAPS 

CORSET 
VIDI. VTD 
REAOVS 

SAVE, WRITE, 


Detailed raster display of pupil/ 
corneal intensity seen by vidis- 
sector 

Corneal acquisition routine 

vidissector input routines 

Converts vidissector anode output 
values to light intensities 

Wain loop of program 


20-21 REEIAY Routines to replay tor. the video 

display) tracking patterns that 
had been saved during actual eye- 
track i ng expe r i-r.ent a 


21 

INTSG 

Routine for doing moving average 
smoothing of eye-track values 

23 

tfAST 

Fast mode routine 

24 

CIRC 

Plots a circle on the display in¬ 
dicating the present fixation point 
q± the eye ; also does the saving 
for later replay if in that mode 

2 5 

DPYSUB 

Routine that display all odd points 
of eye fixation that have been 
saved 

26-27 

DISPXR 

Display subroutines 

28 

FOCUS 

Displays pupi1/cornea1 intensities 
along the horizontal (x) coordi¬ 
nate, through the corneal highlight 


FOSAVE 

Saves then displays last "FOSVM0 ,k 


focus lines 
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29 TRASS 

CAL IB 

30 CALI ST 
31-32 

While all the above rout 


Converts vidisacetor coordinates 
to coorsspending display coordi¬ 
nates 

five-point calibration routine 

Used by calibration routine 

Various back-up routines for 
responding to teletype input 

es are essential to the operation 


of the Oculometer system developed here, the routines entitled 
EYTRAK, BLIHK* PUPTK, CDRTK, FIDGET, CORGET, ItlTEG and CAL IB con 
tain the heart of the eye-tracking section of the program. The 
remaining routines are utilitarian or parametric in nature and 


are primarily concerned with general system operation and testing 
The Oculometer eye-tracking/control program has a number of 
modes of operation as described above. These are COnonanded from 
either a TTY or display-type I/O terminal. Commands consist of 
double characters which appear on page one {1) of the program 
listing* Page two (2) lists the meanings of these character sets 
The program is arranged to interrupt its computation whenever a 
character set is inserted by the operator. The character set. is 
tested against the list of possible program commands, The set is 
ignored if not meaningful; otherwise it is processed immediately* 


The commands are so chosen that processing corresponds simply to 
a jump to an appropriate routine, from which computation proceeds 
These commands are basically of two typess (1) those which are 



used to change the value of parjrseters which are involved in the 
operation of a program, and (2} those which switch the program to 
a different operation routine* After completion of the first type 
of command the program continues from its point of interruption* 
However, the program does not return to its interruption point 
after responding to the second type of command. 

Description of the Eye-Tracking/Control program Variables 


The following is a description of the program variables used 
by the EYTRAK, BLINK, PUFTK, CORTK, PUFGET, CORGET, IHTEG and 


CALIB routines! 


a} Input variables 


TIMLIM Humber of cycles to be spent in eye-track 


FA STEW 


/ 0 if in fast mode 


b) State Variables 


CORJPHD 


/ □ cornea "seen 11 on last entry 


RUPFHD 


/ □ pupil "seen" on last entry 


PUCHA 


tells PUFTK the state of FUFFHD 


FLAGS 


holds number of SLINK or STINK cycles left to try 


MODE state EYTRAK is in, as followst 

Relevant Program value of Mode Meaning 

BLINK, fiLXNKl, 3 Pupil, cornea in track; keep 

BLIHKi tracking (PUPTK and CORTK} 

2 Pupil in track, cornea lost; con¬ 

tinue to track pupil while trying 
to acquire cornea (CORGETJ 
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Envoy t 

STINK 2 


RINKY 

DINKY 

LDSTS 

BLINKS 

BUAX 

CMAX 

WITEftV, 

PUPBtfC, 

CORBUC 


FUFX, 

PUPY 

PUPRAD 


1 Both pupil and cornea lost; assume 

a blink, i,e, continue to try 
tracking pupil in hopes it will be 
in same place when eyelid opens. 

Dd this BLMAX times. 


0 Both pupil and cornea lost and it 

does not seem to be a blink, i.e. 
we have lost track and need to go 
looking for the pupil* First 
search field of view of vidissector 
(PUFGET), DO this CMAX times* 

Mode zero failed* Pupil not with¬ 
in field of view, so start moving 
mirrors* First try a spiral out 
from last knowh position of pupil? 
do once, 

-2 Mode -1 failed* Move mirrors over 

their whole range in a coarse 
raster* Do this until acquisition* 


^ 0 lost eye completely (modes 0, —1, -2} 
jt o loss of track, assume blink (mode 1) 
number of cycles to assume blink 


number of cycles to search before resorting to moving 
the mirrors 


Intensity 



(Pupil/corneal intensity along- horizontal (x) coordi¬ 
nate, through the corneal highlight) 


X.Y coordinates of center of pupil 
Radius of pupil 
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CORAX, 

CCfiAY X, Y coordinates of center of corneal highlight 

CORRAD Radius of cornea 


CORY, 

CORY X,Y coordinates o£ center of corneal highlight 

relative to center of pupil 

c) Local variables 


TCT 


number of cycles we have been in eye-track this time 


WITEAV {pi) \ points actually read by vidis- 

\ sector. Points define pupil end 
Points stored for computation;! corneal highlight boundaries. 


PAWL (P2) 
PBWL (P 3) 
FCWL (P4) 
CORVAXi [P 5 ) 
AVAL (P6) 
BWIr (P71 
CVAL (PBj 
PWL (P9) 



These intensity values are used in 
calculation of PUpx, PUPX-*, 

(see State Variables)* 


PA 

PB 

PC 

PD 

PE 


HXZ 

WY3 

MXR 

MYR 


CDRX, CORY at the five points on the X*Y video display 
used to calibrate the Oculomotor 

I mi i 

. . 

¥ ¥ 

. j| XjY video display 

| horizontal field of view ?:12.5 0 
* * ^ vertical field of view s 9,5° 

Computed by CALIB {the calibration) and used to trans- 
form a given cqrx, cory pair into a point of regard 
[see IKTEC - TRBAB)„ 


SCRT'AX 
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Ifajcbnum screen coordinates (0 ■ imin) 




In CALIS: 


KXZ 


4 * PE x +PAx+ PB^H-PC^PD* 



MYZ 


4+PE„+PA +PB +PC +PD 

y y y Y Y 


rtxn 

MYR 


BCRMftX*2 

PA * +PB *- pc J T |,1) * 


SCRHAX*2 


PA y +PB y -PBy-PC^ 


IR TREftBt 

POR * tCORX-MXZ)KXR 

JL, 

PORy “ {GORY’ttYZjMYR 

POR - point of regard relative to center of screen 


Initialisation of tine 
Cctilometer Ey^-Tra Aing/Cuiitrol Program 


Two types of Initialization must occur prior to operating 
the computer-controlled Oculometer system* They are defined as 
program initialization and tracking initialization* Program ini¬ 
tialization generally need happen only once — when the ays tent 
program begins to be executed* it i& concerned with loading the 
computer memory with the eye-tracking/control program, opening 
the channels for the several i/o devices used, and preparing to 
process TTY or I/O terminal inputs. Tracking initialization 
refers to identifying and localizing the subject's eye in the 
vidissector field Of view* This procedure is accomplished 
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through the use of the SCRT5T and CALI3 routines. After the 
CALIB routine is accomplished the program proceeds to the FYTRAK 

routine and normal system operation, barring any tracking mal¬ 
functions, should a tracking malfunction occur after CALIB, the 
routines 5CRTST ahd CAL1E can he repeated* 

Oculomotor Eye-Tracking Algorithm 

The OcmlDmeter eye-tracking algorithm is concerned with the 
fallowing problem^ giver, a two-dimensional image of the sub¬ 
ject's eye, consisting of a bright pupil with an overriding cor¬ 
neal highlight, which a) is focussed on the vidia$ectcr photo¬ 
cathode, b) can move within the vidififiectot field of View {as 
with head motion), and c) ca.n be occluded so as to momentarily 
vanish (as in a blink), repeatedly determine, with high cycle 
rate, the position of the center of the pupil in the vidissector 
field of view and the position of the center of the corneal high¬ 
light relative to the center of the pupil * 

The requirement of high cycle rate (to insure tracking of 
swift eye movements) demands the utmost of simplicity in the 
tracking algorithm. Also, the natural, dynamic geometry of the 
human eye makes it necessary to deal with situations when the 
pupil is noncircular (as is the case when the upper eyelid is 
partially lowered and obscures the upper portion of the pupil)* 
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The algorithm evolved here appears to meet the tracking 
requirements , 

The (EYTRAK) program organization itself is unusual; when 
tracking the eye, it operates as a closed subroutine, calling a 

pupil tracking subroutine fPUPTRK) and a cornea tracking subrou- 

■■ 

tine (oqrthk}, then exiting to its calling procedure* This code 

takes about five pages, PUPTRK and CORTPJC are each one page 

long, the rest being utility routines. 

The bulk of the code is a rather elaborate collection of 

contingency routines to be used when either PUPTRK or cortrk fail 

This may happen when initially acquiring the pupil image (PUPCET) 

acquiring the corneal image (CORGET), or in the event of blinks, 

sudden movements or changes in light levels (BLINKY, BLINK X etc*} 

Although the tracking program described here was originally 

intended to be exactly analogous to the tracking program of the 

*1 

previous ana log-digital hybrid electronics version o£ the ocu- 
loiueter, it makes some concessions to continuous techniques of 
the latter, in particular, the tracking algorithm of the pre¬ 
vious version of the Oculomotor involved gating the anode current 
of the vidiesector {less a bucking voltage) into several differ¬ 
ent integrators with sign of either +1 or -1 {see Ref* 1)* The 
PUPIL x—dimension loop is illustrative. During the circular scan 
of the pupil two intervals were designated as PUPIL x times, as 
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as indicated below: 



pupil 
Xi time 


PUPIL x, extended from 67.5° to 13S & ; PUPIL *2 time covered the 
symmetrically opposite interval* The pupil bucking voltage 
(PUBUCK in EYTRAK) was selected to be the mean of the pupil inten¬ 


sity (white sense} 


and the background intensity (black sense} 


(B) . The PUPIL x value (PUP3C) was derived as FUPX-PUPX + 
pupil 


f f 


pupil :<2 


(anode voltage - pupil buck voltage) dt - 
(anode voltage - pupil buck voltage) dt* Thua, if 


the circular scan (centered around (PUPX, PUPY)} coincided exactly 
with pupil-iris boundary, the anode voltage value would be exactly 
the mean of dark value and light value (=PUBUCK), both integrals 


= o t and PUPX would he correct. A displacement of the scan to 

r x i /* x 2 

the right would make / <0 and / >0, resulting in a left- 

i 

ward correction of pUfx* similarly , a left scan displacement 


would result in a right correction* This is indicated below: 

y I vidissector a per- </. anode voltage 

' , ^/ r ture value * ^/^pupi 

sjf pupil 3&0 ^ FUBttCK -"V 

/>| f Ba^iQ s S\ 

correct ^, 




<PUBUCK 

J X1 < 0 


/ right scan 
^ displaced 


S 


anode voltage / 
PUBUCK f X 1 > 0 
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Note that, in general, this correction la not linear with dis¬ 
placement , as indicated below* 



The correction is pseudolinear for a range nearly the 
diameter of the vidissector aperture, hut gives only a displace¬ 
ment direction for greater errors» This abbreviated linear range 
is a serious drawback, l£ the Y scan value is also incorrect, 
even the saturated range is shorter» This property was also a 
serious drawback of the scanning algorithm of the previous 
ana lag-digital hybrid system. 

In the previous system there was a pupil x tracking loop as 
described, and a pupil y tracking loop, which used only the 
bottom of the eye image (to permit the eyelid to close down over 
the pupil slightly), as indicated on the following page: 













■white 



time (B)* At the beginning of the 3/4 circular scan there was a 
white sense time (A). Thus, 


pupy = pupy 


-/ 


pupil y 


[anode voltage - pupil bunk voltage)dt 


and 


white sense (A) 

PCJBUCK *- PUBUCK j f {anode vaItage - pupi 1 buck vo-1 1 a ge} dt 



/ 


blade sense (E J 


(anode voltage ~ pupil buck voltage)dt * 


Similarly, the pupil radius is calculated as 


/ 


whole scan 

PUPRAD — PUPRAD + f (anode voltage - pupil buck 

voltage) dt , 


Although the tracking equation 3 are represented above as 
discrete substitutions occurring once per cycle (as they are In 
the present EYTHAK program) the previous version of the tracking 
program actually updated each variable value continuously during 
the whole scan* This had the annoying effect that the pupil 
radius "altie just after the PUP lb X L interval would be decreased 
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if the tracking were right-displaced and increased if track were 


left-displaced. Thus, the scan was seldom quite exactly circular, 
an effect minimized by scaling the correction factors downward toy 
a constant multiplier (a potentiometer] to decrease loop gain, 

This reduced output jitter, but it reduced response rates also. 

The present program PUFTRK works substantially as described 
above, but the 3/4 circular scan has been replaced by a three- 
point discrete scan; the intervals replaced by sum 5 - and the 
anode current integrated while measuring time to reach a threshold 
level, then the time reconverted to light values by a division- 
The- variables PUPX, FUPY, PUPWD and PUBUCK are corrected once 

.. I 

each cycle. The value of PUBUCK gives a criterion for whether 
the tracking is successful: if FUBUCK decreases below a minimum 
value, it is assumed the wiTEftV point (Pi) has been outside 
the pupil image for too long, and that pupil track is lost (the 
switch pupfne = o for lost, +1 for ok), Each time puftrx is 
entered the cycle count PUPCYC is incremented by 1. For the 
first 50 cycles (or whenever FUCHA / 0) the test on PPBUCK is 
relaxed; it is assumed that the pupil has just been acquired and 
PUBUC K nay not yet have reached its steady state value, A com¬ 
plete cycle of FUFTRK involves four vldissector points. These 
are indicated on the following page; 


>L 
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P 3 


P1—^WITEAV 
p2—p-PAVA1 

P 3 — PBVAL 
P4—^PCVAL 


P 2 Pi 



"black Sense" is arbi¬ 
trarily set to " 0 " 
value*} 


in the previous version of the Oculoneter the PUPIL track- 
iny loop described above waa executed alternately with a corneal 
tracking loop. The same procedure is used in the present EYTRAK 
program and the few differences are relatively minor. In the pre 
vious version corneal tucking voltage and corneal radius were 
runua 11 y-sct constants* The corneal acan covered a full circle, 
i.e. CORNER ¥ has two equal intervals, as did CORNEA X* In 
making the corneal scan discrete in the present program the pat¬ 
tern has teen changed from a circle to an x-like pattern of five 
points, as indicated below: 


P5—'-CORVAL 
P6 -*AVAL 
P7 —i-EVAL 
PB -~CVAL 
P9- --.OVAL 



, P 0 


The corneal bucking voltage (CORBUC) is taken as the average 
value of cORVftl and WITEAV. The values calculated by COR'i'RK are 
CORAX, CORAY j, CORX, CORY, CORHAD and COR BBC. CORBUC ia tested 
against WITRAV except during the first 50 cycles (CORCYC < 50 ), 
The scan radius Is fixed. The tine allotted by the program to 


4fc 


measure any point (Pi through P9) is not more than 134 $ec per 


point, although the average total time consumed per point is 
approximately 300 sec because of program overhead* 

Oculomotor Eye-Tracking Program Flow charts 

Flow charts for the Oculometer eye-tracking program routines 
EYETKAK (Eye Track), PUPTK (Pupil Track), CORTK (Cornea Track), 
FUPGET (Pupil Get), and CDRGET (cornea Get) are presented on the 
following pagest 
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EYTEAK 


EYTRAK: 


MALOQ: 


TIMLIM-^A 
TCT^-2 
G-^-PlAGE 
FASTSW-i-0 


Ai 


i 


PUPFKD 


T 1 

1 YES 

PTJCHA^- -1 

J 

_ 

f PUPTK j 

/ pf\\ 

rrNin 

t E v 1 

”y 

] 

YES 


0> 


HO 


HO 



CORF1TO 


> 


YES 


MODE-^3 




COREMU = 

0 / -*1 

| 

NO 

g 

_ f /’inD, 1 " Finn 


1 LUKuL L 

J 


C CORTK 


J 

J_ 1 

[——-V NO i 


»^CORLO^ 





























EYTJRAK (eontirtu^d) 


EXIT: 



GOBAXl 


COKLOSi 


< 


< 


FUPFETD 

—-i 

LOSTS'* 

-0 

BLINKS-- 

■»-0 

. 


FASTEW 

■ 0 


' YES 

TCT-I-TCT + 2 

1 

f 

TCT >TIMLIM 

1 

^ YES 

MODE 


- 2 


/ — FAST ) 
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EVTRAK {continued) 




BLINK: 


JJLJNKI: 


BLINKSt 


MODE:: 


■ 2 

1 
0 
1 

2 
3 




PUCHft t- 0 


C 


I 


PUSBJ PUPTK 



POUND 



) 


YES 


n 

[» 

TCT-*~TCT + 1 

ZZ 3 


TCT > TINLIM^ 

' j 

1 YES 

MODE 

■ i _ 

*— I 


- - • — -■ 

- I 


/ 


3 


YES 




1 

1 NO 

G^— 

cmx 






NO 
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EYTRAK {continued) 


STINKY 


■ c 


PUSH* PUPGET 


f 

m i 


PlfPFND = 0 




< TCT > TIMLIH 


NO 



STINKS 


KINKY: 


G—G - 1 

1 

[ 

<^ G 

> 0 


L k ° 

I.OSTS-#" “1 
BLINKS ^-0 j 

A ■«— PUPX, , PUPY 

j 


f ptrsMJ 

CIRINl') 

3 

\ 

£ PUSHJ 

SPIRIT J 





check if spiral has 
hit any boundary 



Initialize spiral 
mirror search 

Get next x f ,Y mirror 
coord 


\ Y£E 

-W TOO BIG ] 
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EVTKAK (continued) 

- ± -- HO 

< TCT > TIHLIM 



1 YES 

MODE —-1 






ah-temit” \* 

| P 


< 


f PUSHJ 

MIRfi(X) J 

] 

\ 

Q PUSHJ 

PUFGET J 

J 

_ 


PUFPND 


TOOFARt 


A MIRMAX 
B— KIRMAY 
C MIRXKC 
D -—MIRYNC 


DINKY : 


i 


PUSHJ 

RASINI^1 



r pushj 

RA5GEN J 

i 

A^A + 

MIRZER | 

\ 


Q PUSHJ 

MIRRDO J 

_:_ i 


^ PUSHJ PUFGET 




send mirrors 


search for pupil 



last resort 
initialise mirror 


use ra aCur genera tor 
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EYTftAK (continued) 


PUPFND = 0 

1 

YES 

t 

TCT — TCT + 1 

i 


TCT > TIhSLIM 

1 

YES 

| MODE 

P--r2 





H0 

DINKY ] 
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PUPIL TRACK 


PUPTKt Set up to road following points from vidieaector 


Pit 

PUPX + PUPHAD/2 r ,PUPY f+ if CO 

RX < 01 

P2: 

PUPX- FUPflAD., , PUPY 

Fl: 

PUPX + PUPRADj , PUPX 


P4 r 

PUPX,,PUPY+PUFRAD 



WlfEAV^(IPl-WITBAV)/4 + tf i TKV 

PUSUCK —WITEA V/2 

t- 


PAVAL^IPS: 

PHVAL-.-IP3 

PCVAL-^IP4 


popy- £c v A l -. i p UB uck t pupY 


PUFX-p- PBVAL PAVj\L + ^ upx 

J_Cl 




-PUBUCK *44PUBUCK+PAVAL tPBUAL-h PCVAL 

12 S 

I 


YES 
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PUCM =0 


, 

1 1x5 


FUPRA D * 

B+PUPRAD 


j 

r 

1 

YES 

<T PUPRAD > 0 ^ 


NO 


V 


PUPRAD 

Soo 













































F0P1L TRACK (continued) 


POK 


...J 


PUPCYC = POTCYC + i 

s 

r-— 


< PUCHA =* 0 


I 


NO 


<^PLrpC¥G <50 ^ 


I 


NO 


PUBOCK < FUKMIM> 




RETURN 


without skipping ■ error 


NO 


PUPCYC > IQO -^PQKI^ 



1 YES 


send out pupx,,pupy to mirrors 





AOS (P) 




set for skip 


c 


i 


RETURN 


J 
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'hi 


CORNEAL TRACK 


Set up to read the following points from the viditjgector 
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OORNBAli TRACK (continued) 





















PUPIL GET 


PWGETi 


NEN1KM: 


NEffPT; 



HOtfWAX 0 


E initialize 

over whole 

raster scan 

Screen 




WITESW — 0 
WITECT -+—Q 
BFtlTSM—0 


i 

. 


c 


PUS1U RGSGET 


l 


D 


< C RQSNO ~ 0 



£90 


( 


i 


VES 




■ i ■ ■ 

PUSHJ VIDI 


3 


< 






YES 


WITSSW > 0 


< *■-'- - 

WI1 

8 - fl-MliTlF 


1 


yus 


WITECT £ PUPMltl 


YES 


^ WITECT ^ RQWHAX 


YES 



[intensity returned in 
in B. small ' darX 
large = bright) 


I 


WITEAV *- EEITSM 

WITECT 
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PUPII. GET (continued) 



XHPU; 


PFINDi 


POUT; 


BRI15M—&RITSM + B 
WlTESfrr^-1 

WITECT-* WITECT + 1 
XRQW — FLOSX 



PUPRAD _ W1TSCT«PIJPIMC 

2 

FUFX*—XRCW - PUPRAD 
PUFY *—ROSY 
PUPCYC ’•—'0 
PUPFND *— -1 

WITEAV 
PUBUCK- 2 

1 

[return! 













4-1 


CORNEAL GET 


CORGETi 


initialize for raster scan in 
square containing pupil 





WITEAV*aRAT 

ERITLV -* 

26 



PUSI-U ROSGEK 


l 


ROSNQ 0 


1 


YES 


FUSHJ VID 




NO 


B > CQRMAX 
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COKHEflX. GET (continued) 


RASDUNj 


taocoRi 


COHBUC- 

CORHAY + 

WITEAV 

~ 2 


CORAX 

-(R05BKS) l 


CORAV-^ 

-(BOSEES) R 



< OORMAX > BfcITLV 
^ 



YES 

































Calibration and point of Regard Calculation 


The tryo-track inq algorithm described above requires an 
Outer loop to make Use of the raw data it supplies for the pur¬ 
pose of calculating the subject's point of regard* Calibration 
permits the relationship to be established between the raw eye- 
track data and the point of regard* The point of regard is nor¬ 
mally construed to be located within the boundaries of the video 
display screen* calibration is accomplished as follows, after 
the subject is properly positioned at the Oculometer and after 
the routine SCRT&t has been completed and EYTRAK is operating! 

a} The cALIB routine presents five (5J points, pa, fb, pc, 
Pb, and PE, in succession on the video display to the subject as 
indicated; 

X,Y video display 

1 horizontal field of view ss 1 2. 5° 
vertical field of view ^9.5° 

b) The EYTRAK routine is then required to obtain sixty-fcur 
(64) consecutive measuxement periods at each of the five (5} cali¬ 
bration pointsi 

c) The sixty-four (64) measurements at each calibration 
point are averaged by CALlb to get one COKX and one CORY value 
fox each of the five (5) points. 


• PC 

FB # 


• PE 

« PD 

PA • 
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d} The CQF-X and CORY values are used by CALIB to ca lcula te 
“0 ,h offset values mxz and myz . 

e) The values SCRHUC (maximum video display screen coordi- 
nates) and the averaged values of each of the pa, fb, pc and fd 
points are used by CAL1B to calculate values MXR and MVR- 

f) The values FORX and fOry (values for point of regard in 
x r y coordinates on the video display) are calculated by CALIE 
using values oqrx, gory, wxz, myz, mkr and myfu 

Bata Display 

After the routine CALIB has been successfully accomplished 
and the routine EYTRAK is running, the routine CIRC will display 
the subject's point of regard (fixation point) at the correct 
fixation position on the video display. 

A certain amount of smoothing of the displayed fixation 
point (to reduce fixation jitter*) is accomplished by using rou¬ 
tine IHTEG. This smoothing is obtained by doing a moving average 
of the last ten (10) values.of eytrak output provided to CIRC- 

Other display features of the present Qculometer program 
are the routines REPLAY and DPYSU&. The former routine will 
replay (on the video display) the fixation point pattern of a 
subject developed during an eye-tracking experiment. The latter 
routine DFYSUB will display all the old points of an eye fixation 
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pattern that the program has been instructed to save. 


DISCUSSION OF COMPUTER-CONTROLLED OCULOMETER 
SYSTEM PERFORMANCE AND APPLICATION 

Evaluation of system Performance 

£he work reported here was primarily in the nature of a 
system feasibility study, i.e* the initial development of speci¬ 
alized computer-oculometer eye-tracking/contrql programs and i/o 
interfaces for a prototype interactive eye movement tracking 
system, because of this, the time allotted for quantitative 
evaluation of the system w&3 minimal* However, the qualitative 
results were encouraging. Digital computer control of the system 
allowed Gculometer performance that was generally equal to, and 
in some instances superior to, the performance obtained with the 
previous analog—digital hybrid system control circuitry* An 
example of the improved performance capability of the present 
Oculometer system is its ability (unlike that of the previous 
system) to> operate under well-lighted room conditions. This per¬ 
formance feature is a particular result of the present EYTPAK 
program and the integrator-threshold detector described elsewhere 
in the report* 
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During the development of the calibration program (CALIB) 
for the present system some quantitative information was obtained 
regarding values of fixation point (oyc point of regard) random 
noise level and repeatability of measurement - These values^ 
which are listed below, represent the video display output of the 
system after the raw eye-track data has been smoothed by the 
moving average 1NTEG routine* 

a) fixation point random noise level — 

For artificial eye (see Appendix c) s=+ 3/8° 

For human eye (subject fixated on static 

point on video display with head pa si- 

tion fixed in holder) s+ 1/3 

b) Repeatability of measurement 

(human aye only) -- 

Subject head position fixed in holder ss^ 1/4° 

Subject head position not fixed in holder s+ 5/6° 

The above values (over horizontal and vertical fields of view 
of 13*5° and 9*5° respectively) are indicative only of the general 
performance of tfre particular ocuiometer electro-opt leal unit 

E 

used in the present system, which employe a vidiesector with a 
circular scanning aperture of approximately 20 mils diameters and 
a nonsophisticated near-infrared optical subsystem. An Ocuiometer 
electro-optical unit utilizing a smaller aperture vidiesector and 
an improved near-infrared optical subsystem (sec Ref* 5) would be 
expected to provide even better performance. 
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System Demonstrations and Applications 

The fiuceafla of the computer-control led Oculometer system 
developed here shows the feasibility of developing a compact 
Oculometer system utilizing a small, dedicated, digital computer 
for Oculometer control» 

The applications of such a system appear to be many and 
varied. As an example, eye—tracking data developed by a compact, 
digit a 1-CDmputer-cOnt rolled Oculometer system could, be used as an 
input to a large digital computer, as suggested by Geffnar (see 
Ref. G and Appendix E) for large-scale interactive experimentation. 

5 

Some other examples of Oculometer system applications, based 
on demonstrations performed during the accomplishment of this 
work, are as follows: 

a) Using the eye as a control device , in this demonstration 
(see Fig. 13) the subject's eye movements controlled the position 
of a "box" which could be made to overlay a "moving bird" target 
which moved with random acceleration in various directions * The 

I 

movements of the "bird" would be minimized so long as the subject 
continued to eye-position the "box" ovur the "bird". 

b) Recording eye fixation point and exploration patterns * 

In this demonstration the subject f s eye movements were monitored 
and displayed while he "flew" a flight simulator* The flight 

p 
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Figure 13 OCULOMETER AS A CONTROL OEVICE 
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simulator consisted of a PDF-6 computer {using a special program 
(see Appendix: D)) with an instrument panel displayed on its X, Y 
video display {see pig.19}. A particular eye fixation point of 
the subject is clearly displayed on the video display below the 
center of the central instrument as shown in Fig- 20. 

c) Using the eye in game playing - In this demonstration 
(s go Fig* 21) a "ball" game was being played by two subjects. 

Two box-like "bumpers", one of which was controlled by one 
subject manipulating a joystick and the other controlled by the 
other subject's eye movements, were independently maneuvered in 
front ot the '’ball' 1 so as to deflect it and cause it to cross a 
particular set of boundaries, thus making a score for one or the 
other player {see also Appendix fi)- 

d) Using the eye in training machines and in psychejp h ys io - 
logical testing * Demonstrations in these areas are explained 
and depicted in Appendix F* 


CONCLUSIONS 

The feasibility of using the digital computer technique of 
eculoneter control has been successfully demonstrated here in the 
development of a prototype interactive eye-movement tracking 
system. This technique is capable of providing the following 










Figure 19 PDF-6 COMPUTER WITH FLlCHT SIMULATOR DISPLAY 
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Fiyure 21 OCULOMETEfi USED IN GAME FLAYING 
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a dvant ages: 

a) real-time analyses of data, 

b) interactive ersexiir,ent e r 

c) precision timing source, 

d} flexibility o£ experiment&, 

e) improved eye-tracking accuracy by using predictive 
programs, 

£) new eyo-tracking schemes by using program flexibility, 
g) improved system accuracy resulting from removal of 
nonlinearities by special programming* 

The results of the work described here seem sufficiently 
promising to warrant further development of both Dculorceter 
electro-optical subsystems and Oculometer eye-tracking/control 
programs, to be utilized with dedicated t compact, digital com¬ 
puters,. which could be combined to form complete Oculometer 
systems - 
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APPENDIX A 

OCULOMETER EYE-TRACKING/CONTROL PROGRAM 

A digital computer eye-tracking control program has been 
written for the Oculometer* A listing of this program may be obtained 

from the N.X.T. Artificial Intelligence Laboratory. 
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APPENDIX B 


IMPROVED OCULOMETER POWER SUPPLV 
AND NEAR-INFPARED LIGHT SOURCE 

' Power Supply 

An improved power supply unit has been designed to accomo¬ 
date nearly any ocu 1 ometer electro-optical unit ‘(see Fig* b-11 . 

The design utilizes components selected for excellence of perform¬ 
ance, and no other criteria were used* consequently, the unit is 
rather heavy, hut it represents a highly reliable piece of 
labora to ry equipment. 

A transistor-relay fail safe circuit has been incorporated 
in the power supply unit to protect the vidissoctor deflection 
amplifiers in the event that the vidissector yoke coils have not 
been connected* The circuit has a series connection through the 
x and y yoke coil output connectors, and power will not be deliv¬ 
ered until these connectors ate in place* Two pins have been 
clipped in each of the output connectors to insure that the yoke 
coils are connected before the relay is connected* Also, if the 
feailure of either supply causes it to go to ground level, the 
relay will open and prevent an unbalanced supply to the amplifiers* 

The deflection amplifiers incorporate a damping control to 
minimize overshoot regardless of yoke coil inductance. This control 
is adjusted with R, on the amplifiers, Rj on the amplifiers adjusts 
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Figure B-l IMPROVED OCliLOMETER * SUPPLY SCHEMATIC 






























































































































































the DC level at the output, R G should be adjusted before R 7 sines 
it will have an effect on the aero signal output current. 

Spurious oscillations occurred in the deflection amplifier 
outputs during the initial tests of the power supply unit* It 
was determined that this was due to the capacitive effects of 
the leads to the X and Y monitor outputs, A. small resistor was 
placed in series with these leads at the amplifier to isolate 
the monitoring circuit from the amplifier* Capacitors were also 
placed between the outputs of the defelction supplies and power 
ground to eliminate any ripple that may be present there* ^htase 
additions are Included in the schematic wiring diagram of the 
power supply unit* Fig. b-1* 

vidissector focus current is adjusted with a trimmer poten¬ 
tiometer at the top of the focus current regulator card (FR 1382]* 
A switch is also available on this card to switch the direction 
of the focus current, once the switch position is selected, it 
should not be disturbed, since reversing it could damage the 
focus current ammeter (unless the ammeter connections are 
reversed also)« 

Upon initial testing of the power supply unit, it was 
observed that a herringbone pattern was present in the video 
output of the vidissector during a test-raster display mode of 
operation* The focus current regulator was found to be the 
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source of the problem, and appropriate components wore added to 
it to eliminate the aberrations in its output. The added ele¬ 
ments are illustrated in the focus current regulator circuit 

diagram {sec Fig. b-2 ) by heavy, dark line drawing. 

The power supplies {LH-D-20-Y) of the deflection amplifiers 
are grounded at the power ground terminal of the amplifiers and 
at no other point, The BNC input connectors of the deflection 
amplifiers are floated off the panel face with insulators. This 
means that the ground level of the deflection circuit will be 
established at the signal source. All other power supplies axe 
chassis grounded. 

The shield of the vidissector high voltage coax is chassis 

grounded and no ground connection should be made to the body of 

1 

the optical head. 

The wiring diagram of the vidissector in the oculomotor 
electro-optical unit is included in Pig. b-1 for completeness. 






Figure B-2 FOCUS CURRENT REGULATOR SCHEMATIC (MODIFIED) 
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Fewer supply Recommended operating valued 


FOCUS Coil 



ISO 


vidissector 

High 

Voltage 

-2000 

v 

vidis sector 

DT - 

and 

-1600 

V 

Vidissector 

DT « 

Dl 

0 

V 

VidiSaOctOx 

DT - 

E2 

-36 

V 

Vidissedtor 

09 - 

and 

-265 

y 

Vidi b a actor 

DIO - 

■ and 

-119 

V 


Power Supply Parts List 


Quantity 


Power g ujppl left 

Electronic Research Associates, Inc* 

Model #LC 3 210 

4-32 VDC, 12* 5a. @ 35°G 1 

ACDC Electronics, Inc- 
Model #BX34DO.6-12 

+ 34 V£>C, 0*6a, @ 71°C 1 

La,nihda Electronics Corporation 
Model #LM-D-20-Y 

20 VDC, 7,4a, @ 40^C 2 

Del Electronics Corporation 
Model #2 * 5HRM4NI 

1.3 J£V - 2,5 XV @ 4 ma.. 1 
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Deflection Amplifier 


Celco 

Model *Dft-FP2N-7 

input +2 v 

output ±2 a. 1 

Focus Current Regulator 

Seta Instrument Corporation 
Model #FR 1802 

2D ma. to 300 ma * 1 

Relay 

Potter and Brumfield 
Model #KXP 11 D 

coil - 50 CHI 

24 volts nominal 1 

Translator 

PNP-2N2905 or equivalent 1 

Reaiatora 

30 kft, 1/4 W 1 

10 kft, 1/4 w 1 

390fi, 1/2 W 1 

resistor as desired for high voltage 1 

adjustment (temp, coeff., 30 PPM or better)' 

Connectora 

Burndy (bent mount receptacle) 

Part #BT02-P-10SX 

10 socket contacts (# 20 ) 1 


Burndy (box mount receptacle) 
Part #BT02-F-12-10SW 
10 socket contacts (# 20 ) 


1 
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fiurhdy (straight plug) 

Part #BT06^AC-12-1 Qfj£ 

10 pin contacts (# 20 ) 1 

Burncty (straight plug) 

Part #BTQ6“AC“12-1QPW 

10 pin contacts (#2o) 1 

Burndy (box mount receptacle) 

Part #BT 02 -P- 14 - 12 £Y 

13 socket contacts (4 #16, 8 #20) 1 

Burndy (straight plug) 

Part #BT06-ftC-14-12pY 

12 pin contacts (4 #16 f ft #20) 1 

KHV high voltage connector 
(receptacle and plug) 

UG932/U , 1 

Banana jack (heavy duty) 4 

BNC jack (standard) 2 


Simpson - wide vue 

Model #1327, 0-50 V 2 

Simpson - Wide Vue 

Model #1327, 0-500 ma 1 

Simpson 

Model #29, G-3QG0 V : . ' ‘ 

(with external [multiplier) 1 

Switches 


Arrow-Hart and Hagoman 
Model *82611 

DPDT - 15 A @ 13 5V 5 

Arrow-Eiart and Hegeman 
Model #02699 

DPLT, 3 position, on—off-on 1 
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Indicator Lights 


Dialed 

Model #95-0408 5 

Lamps 

Model #NE-5lH 5 

Fuse Holders 

Littlefuse 

Model. #372001 

SAG fuse extractor post 5 

Near*infrared Light Source 

The Proximate oculometer electro-optical unit light source 
housing has been modified to utilise an a.s.a, PCS tungsten-halogen 
lamp. This lamp replaces the original GE Ho- 1962 tungsten-halogen 
lamp* The FCS lamp has a close—wound, rectangular filament 

I 

nominally o*2is x 0,114 x 0,055 inches in eise* It is capable 
of producing a more uniform illumination of the eye space than 
the former G* E, lamp* The FCS lamp is mounted in a sylvania 
TP-3 ceramic socket t attached to the larjj housing by two screws* 
and is easily replaced* unlike the previous lan p which required 
wire-soldered connections* Although the lamp is rated at 
150 watte (24 V, t. 25 A) , it is being operated at a reduced 
input of approximately 30 watts (1&,5 V, 4*? A). provision is 
made on the lamp power supply (LC 3210) for changing the lamp 
input wattage* The lamp power supply is variable in Htepa from 
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4 to 32 voc by connecting the proper terminals on the hue at the 
back of the supply* Within each step the voltage is varied by 
adiusting Rj^ located on the top of the supply. 

The lamp output is filtered, by the original optical system 
filters and F^ to produce a near-in fra red beam to illuminate 
the subject's eye at the eye space* The illumination beamspread 
is approximately 1*2° as determined by the optical system aper¬ 
ture A 2 and lens L * (&ee Ref- 2, pp. 1, 14 and 15*} 

■■ 

The nominal life of an FCS lamp ia 50 hours when operating 
at rated wattage under recommended cooling conditions, An 
&Q-hour lifetime can be expected for the lamp operating at .the 
HO-watt level under the conditions found in the cculometer lamp 
housing. 

When a lamp is replaced due to failure or aging {discolor* 

I 

at ion of the lamp envelope internally} the following procedure 
should be used; (1) Remove the socket and the lamp from the 
lamp housingj {2} remove the lamp from the socket; (3) replace 

I 

the old lamp with a new one # being careful to keep the lamp 
envelope free of any contamination such as finger moisture or 
oils; (4) replace the socket with the screws (5} turn on lamp 
power and observe position of lamp filament in aperture A ^ - This 
is done by placing the eye at eye space* The lamp filament 
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should be centered in the circular aperture A^+ if it is not 
centered, remove the socket (with power off) and reposition lamp 
3 lightly in the socket* ( 6 ) Repeat steps (4) and (5) as often 
as necessary to secure proper lamp position in aperture h-> . The 
above procedure insures uniform illumination at the subject's eye 
on the optical axis of the image dissector in the oculometer* 

APPENDIX C 

ARTIFICIAL EtfE AND MOUNTINC DEVICE 

An artificial eye and an artificial eye mount were constructed 
to aid in the testing of the Oculometer system* 

The dimensions of the artificial eye, which was machined and 
polished out of methylmethacrylate plastic (n “ 1,49), arc shown 
in Fig* c-1. These dimensions match closely those of the human 
eye and were found to be adequate in the use of the artificial eye 
assembly to relieve a human subject during tedious system adjust¬ 
ments and calibration tests. 

The artificial eye mount (see Figs- C-1 and c-3) was con¬ 
structed from a modified laser mirror mount, with the addition of 

I 

protractor plates which are used to determine the horizontal and 
vertical eye angles* 
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Figure C-l ARTIFICIAL EYE (FLAS-Tic) 
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Figure C-2 ARTIFICIAL EYE AND mount assembly 
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Figure: 0-3 ARTIFICIAL EV6 AM) MOUSTISfi DEVICE 





APPENDIX D 


DIGITAL COMPUTER PLIGHT SIMULATOR PROGRAM 

A digital computer flight simulator program has been written 
for the M.Lf> Project MAC A,I. Group PDP-6 computer (see A.I. 
Memo 2Q9, "Digital Computer Plight Simulator," by D- silver). 

The flight simulator instrument panel is displayed on the 
computer video display while the subject “flys" the simulator 
with a joystick and a "throttle". The subject is presented with 
seven (7) instruments on the video display as follows; 

a) Gyro compass 

b) Air speed 

c) Artificial horizon 

d) Altimeter 

r 

e) H.F.M. (power) 

f) Combination rate of turn/slip 

g) Rate of climb 

The mode of operation of the simulator is as follows: 

1) The subject manipulates the joystick with one hand, using 
three (3) degrees of freedom: 

a) left-right for aileron control, 

b) forward-backward for elevator control, 

c) torque movement for rudder control. 

2) The subject's other hand is used to control the ""throttle 
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In a ptlsh-pill 1 niQt.inn - 


3} The subject is instructed to perform certain numeuvers. 
The output of the displayed instrument panel (viewed by the sub¬ 
ject} is a function of the maneuver performed. 

ft listing of the digital computer flight simulator program 
appears on the following pages: 
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APPENDIX E 


"TElE OCULOMETER 11 FILM NARRATIVE 

This film waa designed to demonstrate the flexibility {end 
some possible applications) of both digital-computer-a eh Ist&d 
and digita 1-computer-con trolled Oculometer systems* 

The first scenes show the Proximate Oculometer, the first 
prototype Oculometer developed for NASA by tbe Honeywell Radia¬ 
tion Center* In this demonstration the computer is simply utiliz¬ 
ing the analog output (eye fixation data} of the Oculometer 
analog—digits1 hybrid circuitry. No computer control of the 
Oculometer is occurring* The proximate Oculometer is set up in 
front of the computer video display and the subject views the 
display through the circular dichroic beamsplitter. Computer- 
generated words appear on the video display in French* As the 
word3 are fixated by the subject their positional coordinates are 
transmitted by the Oculometer to the computer, which translates 
them into their English equivalents and redisplays them, in addi¬ 
tion, the computer is progratimed to vocalize the words as they 
are fixated and translated. 

The next sequence of scenes shows the Remote Oculometer* 

8 

in these scenes the Remote Oculometer is being program-controlled 
by the FPP -6 computer through an i/o interface system and an I/O 
display-type terminal, unlike the proximate Oculometer shown in 
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the previous sequence* The moving mirror hoad^tracking system is 
disabled here and the headrest is used to locate the subject in 
the Held af view of the Oculomotor vidiseector* On the computer 
video display ere seen images of the various control program eye-* 
tracking patterns and program subroutine displays. 

The following scenes show the subject forming various letters 
by eye movements* The subject is tracking the end of a pointer 
which doesn't appear in the scene. It should be noted that the 
eye movements produced are relatively smooth pursuit motions, 
in the next sequence the formation of letters is attempted with¬ 
out the use of a pointer to follow * The eye movements arc not 
smooth,, but rather are a series of saccadic jumps. 

The next scene shows the results of the subject's eye 
tracking a square pattern to provide some suggestion of system 
output linearity. The linearity depicted here proved adequate 
for a wide variety of simple demonstrations, 

For the demonstrations which appear in the following 
sequence of scenes a slide was projected on the video display 
(where the subject was fixating) and the subject (a male) was 
asked to look at the slide and formulate an answer to a question 
he would be asked. The first slide is of an attractive young 
lady and the question asked the first time was "is this a ship's 
figurehead?" The subject scanned all the relevant features of 
the youhg lady and determined that the features wore rather more 
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lifelike than a ship's figurehead* The fixation pattern is 
shown, using the same slide the same subject was asked two more 
questions, "is it a windy day?" and ''Which direction is up in 
the picture?" The fixation patterns produced by the subject arc 
shewn for these latter two questions. Then the sequence of the 
throe fixation patterns are replayed to show the differences 
thit exist* 

Xn the next sequence of scenes a new slide of a young lady 
is projected and three different subjects are all asked the same 
question* as follows* ’’What part of the country was this photo¬ 
graph taken in?" The scanning pattern of the fi-fst subject {a 
rathor shy female) indicated a rather strict attention to terres¬ 
trial detail* The second subject (a male) indicated by his scan¬ 
ning pattern first an interest in the young lady in the photo¬ 
graph and then proceeded to scan the background for clues* The 
third, subject (another male) showed little interest in the back¬ 
ground but much interest in the young lady* as indicated by his 
scan pattern* Thus, three different fixation patterns of the 
same object are displayed by three different subjects* which 
indicate differing approaches to the same visual task* 

The final sequence of scenes shows a simulated "ball" game* 
The ball is being served from up-down and from left-right* The 
object of the game is to deflect the ball across the proper 


boundary using the bumper. The bumper with the horizontal bar 
is joystick-controlled. The bumper with the vertical bar is 
eye-controlled by means of the Odulonnetsr* Left-right boundary 
crcfjsmq scorea for the joystick and up-down boundary crossing 
scores for the oculometer* The bumpers, to be effective, must 
be positioned in front of the hall, in the direction of its 
mot ion, 


H. Because of prohibitive reproduction costs one {1} copy 
only of this film is submitted with this report + 
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